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7/ a noisy channel is used to transmit more than two distinct signals, 
information may have to he specially coded to permit occasional errors to he 
corrected. If pulse amplitude modulation is used, the most prohable error 
is a small one, e.g., 6 is changed to 7 or 5. Codes for correcting single small 
errors, and for correcting single small errors and detecting double small 
errors, in a message of arbitrary length, for an arbitrary number of differ- 
ent signals in the channel, are derived in this paper. 

For more specialized situations, the error is not necessarily restricted to a 
small value. Codes are derived for correcting any single unrestricted error 
in a message of arbitrary length for an arbitrary number of different sig- 
nals. 

Finally, a set of codes based partially upon the Reed-Muller codes is 
described for correcting a number of errors in a more restricted class of 
message lengths for an arbitrary number of different signals. 

The described codes are readily implemented. Many techniques are used 
which have an analog in a binary system. Other techniques are broadly 
analogous to binary coding techniques or are special adaptations of a 
binary code. 

I. INTRODUCTION 

1.1 Use of Error Correction Codes 

One function of an error correction code is to aid in the correct trans- 
mission of digital information over a noisy channel. This process is 
illustrated in Fig. 1. An information source gives information to an 
encoder; the encoder converts the information into a message containing 
sufficient redundancy to permit the message to be slightly mutilated by 
the noisy channel and still be correctly interpreted at the destination. 
The message is then sent "^'ia the noisy channel to a decoder which vn\\ 

* This paper was submitted to Columbia University in partial fulfillment of 
the requirements for the degree of Doctor of Engineering Science in the Faculty 
of Engineering. 
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reconstruct the original information if the mutilation has not been ex- 
cessive. Finally, the information is sent to an information receptor. 

One scheme for correcting errors in a binary system is to send each 
binary digit of information three times and to accept at the receiver 
that value which is represented by two or three of the received digits. 
Then, the encoder is simply an instrument for causing each digit to be 
sent three times, and the decoder consists of a majority organ. However, 
many methods are available which are considerably more elegant, and 
which wiU permit more information to be passed through a noisy channel 
in a given unit of time. This paper will deal with such methods for 
channels capable of sending 5 different symbols instead of the usual 1 and 
of a binary channel. 

The most convenient explanation of an error correction code has been 
made with respect to the transmission of correct digital information 
over a noisy channel. This does not imply the restriction of such codes 



INFORMATION 
SOURCE 




ENCODER 




CHANNEL 




DECODER 
(CORRECTOR) 




INFORMATION 
RECEPTOR 


— > 




- — *■ 












u 









Fig. 1 



NOISE 

Transmissioii over a noisy channel. 



to the noisy channel problem exclusively. Actually, the first application 
considered for such a code was with respect to computers.^ Many large 
high speed computers stop whenever an error is detected in some calcu- 
lation and must bo restarted; with the use of an error correction code 
this could be avoided by permitting the computer to correct its own 
random errors directly. To the best knowledge of the author, error 
correction codes have not yet been used in any major computer. But 
the storage system of a computer may, in the future, lend itself to the 
use of error correction codes. 

Frequently, very elaborate precautions must be taken in present 
storage systems to insure that they are free from errors. Magnetic tapes 
must be specially made and handled to guarantee the absence of defects, 
magnetic cores must be carefully tested to make sure that no defective 
cores get into an array, cathode ray tubes used in Williams Tube or 
Barrier Grid Tube storage systems must be perfect. Probably, there are 
other storage methods whose development is hampered because of a 
common requirement for error-free performance in all storage locations. 
With the use of error correction codes, such storage systems could be 
used, if they are sufficiently close to perfection, even though not perfect. 
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It is not unlikely that the near future will see the development of 
storage systems which will be able to store moi-e than two states at every 
basic storage location.- If such systems are thn'cloped, it seems likely 
that they will be more erratic or noisy than binary storage systems, 
since each location must store one of b signals instead of one of two. If a 
cathode ray tube storage system were used, for example, difl'erent fiuan- 
tities of charge would have to be distinguished; in a binary storage 
system, only the presence or absence of charge must be detected. This 
suggests that error correction codes may become essential with certain 
types of non-binary storage systems. One object of this paper is to 
develop codes for this purpose and to discover which number systems 
are most easily correctable. 

Some investigations have been made on the use of computer systems 
using multi-state elements.^ A switching algebra has been developed 
similar to Boolean algebra for handling switching problems in terms of 
multi-state elements. Single device ring counters (the cold cathode gas 
stepping tube for example) already exist and might be useful in such 
systems. But currently, only limited steps in this direction have been 
made. Another object of this paper is to show the advantages and 
problems of error correction codes in multi-state systems; it is not un- 
reasonable to predict that error correction codes may be more necessary 
in multi-state systems than in binary systems. 

1 .2 Geometric Concept of Error Correction Codes 

A geometric model of a code was suggested by R. W. Hamming' 
which can be altered slightly to fit the non-binary case. I"or an n digit 
message, a particular message is a point in n dimensional space. A 
single error, however defined, will change the message, and will cor- 
respond to another point in ii dimensional space. The distance between 
the original point and the new point is con.sidered to be unity. Thus, 
the distance d between the points corresponding to any two messages is 
defined as the minimum number of errors which can <'on\ort the first 
message into the second. 

With an error detection and/or correction code, the set of transmitted 
messages is limited so that those which are correctly recei\'ed are recog- 
nizable; tho.se messages which are received with fewer than a given 
number of errors are either corrected or the fact that they are wrong is 
recognized and some other appropriate action {such as stopping a com- 
puter) is taken. 

In the case of binary codes, an error changes a 1 to or a to 1 . In 
the non-binary case, two definitions of an error are pos.sil)le and will be 
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used in this paper. A small error changes a digit to an adjacent value. 
In a decimal system, a change from 1 to 2 or 1 to is a small error. An 

unrestricted error changes a digit to any other valne. In a decimal sys- 
tem, a change fioni 1 to 5 is an unrestricted error. 

1.3 Material To Be Presented 

The various types of codes described in this paper and the sections 
in which they are to be found are summarized in Table I. The tech- 
niques which are described are summarized below. 

The geometric model suggests the simplest approach to error correction 
codes. A transmitter has a "codebook" containing all members of the 
set of transmitted messages. If the message source gives to the encoder 
the signal that the information to be sent is k {that is to say, the A:th 



Table I — Types of Codes 




Type o£ Code 


Distance 


Type of Error 


Described in 
Section 


Single Error Detection 
Single Error Correction 
Single Error Correction 
Prime Number Base 
Composite Number Base 
Single Error Correction 

and 
Double Error Detection 
Multiple Error Correction 


2 

3 
3 

4 


Small and Unrestricted 
Small 

Unrestricted 

Unrestricted 
Small 

Small 


II 

III and 6.1 

4.1 

4.2 
V and 6.1 

6.2 



output of all the outputs associated with the message source), the en- 
coder chooses the fcth member of the set. The decoder will then look up 
the message it receives in its own codebook whicli contains all possible 
received messages, and corresponding to the entry of the received mes- 
sage will find the symbols corresponding to k. Or the receiver may 
compare the received message with every member of the set of trans- 
mitted messages, calculate the distance between the two, and correct 
the received message to whichever of the transmitted messages is sep- 
arated from the received message by the smallest distance. {It has been 
shown by Slepian* that this is the message most likely to be correct in a 
symmetrical binary channel having the property that changes from 1 to 
and from to 1 as a result of noise in the channel are equally likely.) 
The practical difficulty with such a code is the large size of the re- 
quired codebooks. Most coding schemes try to eliminate such codebooks 
and substitute a set of rules for encoding, decoding and correcting 
messages. 
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One approach toward creating a .simple association lietween the infor- 
mation and the message is to use some of the digits of the message for 
conveying information directly. The Hamming Code' uses this tech- 
nique. 

An informaiion digit is a digit of a message that is produced directly 
by the information source; in a base h code, an information digit may 
have h different values, the choice between these values representing the 
information that is to be sent. 

A check digit is a digit of a message that is calculated as a function of 
the information digits by the encoder. It is sometimes convenient to 
represent or calculate a check digit in terms of a recursive formula using 
previously calculated check digits as well as information digits. In a 
base b code, a check digit may have h check states. When more than one 
check digit is used, each different combination of check digits corre- 
sponds to a different check state for the message; a message with m 
check digits will have b"* message check states. 

A systematic^ code encoder generates messages containing only infor- 
mation digits and check digits. The information source generates only 
base () information digits. The Hamming Code is a systematic code. 

Section II offers a general method for obtaining single error detection 
codes for both small and unrestricted errors. The idea of mixed digits 
(digits which are, in a sense, neither information nor check digits, but a 
combination of both) is introduced, and it is shown how mixed digits 
may lead to more efficient coding systems. This idea is believed to be 
novel. Code systems which use mixed digits are called semi-systematic 
codes. Semi-systematic codes are used extensively throughout this 
paper. 

Section III offers a general method for obtaining single small error 
correction codes, including both systematic and semi -systematic codes. 

Section IV offers a general method for obtaining the more complicated 
single um-estricted error correction codes. The problem is divided into 
two parts. Section 4.1 describes codes for correcting single unrestricted 
errors in case b, the base of the chaimel, is a prime number.* Section 4.2 
describes a special technique for obtainhig the more complex codes for 
correcting single unrestricted errors in the event b is a composite num- 
ber. 

Section V offers a general method for obtaining semi-systematic codes 
for correcting single small errors and detecting double small errors. No 
general solution has been found for obtaining single error con-ection or 
double error detection codes for the case of unrestricted errors. No gen- 

* This class of codes was previously described in a brief summary by Golay.* 
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eral solution has lieeii found for multiple error correction codes for the 
unrestricted error case. 

In Section VI, a number of techniciues are presented for using binary 
error correction coding schemes for non-binary error correction codes. 
Section 6.1 shows how such techniques may be used to obtain non-binary 
single error correction codes, and single error correction double error 
detection codes, for the small error case. Section 6.2 presents a special 
technique, involving the use of an adaptation of the Reed-Muller binary 
code, to obtain a class of non-binary multiple error correction codes, for 
the small error case. 

Section VII shows that an iterative technique of binary coding can be 
directly applied to non-binary codes. It also show^s how an adapted 
Reed-Muller code can be profitably used in such a system. 

Section VIII summarizes the results obtained in Sections II-VII and 
shows the advantages and shortcomings of many of these codes. 

Section IX presents general conclusions which may be drawn from 
this paper. 

II. SINULE ERROlt DETECTION CODES 

Single error detection codes require message points separated in n 
dimensional space by a distance of two. 

For the binary case, the only two possible types of errors are the 
change from a 1 to a and from a to a 1 . 

A simple technique that is used frequently for binary error detection 
codes is to encode all messages in such a manner that every message 
contains an even immber of Ts. This is accomplished by adding a parity 
check digit to the information digits of a message; this digit is a 1 if an 
odd number of I's exist in the information digits of a message and is a 
if an even number of I's exist in the information digits. At least two 
errors must occur before a message containing an even number of I's 
can be converted into another message containing an even number of 
I's, since the first error will always cause an odd number of I's to 
appear. A message with an odd number of I's is known to be incorrect.* 

An analogous technique may be used for the unrestricted error case in 
non-binary codes. We can obtain a satisfactory code by adding a com- 
plementing digit to a scries of information digits to form a message. 

A complemeniing digit, base h, is defined as a digit which when added 
to some other digit will yield a multiple of h. 

* Purity check digits may be selected to make the number of I's in a message 
always odd, but the principle is the same; in this ease, an error is recognized if a 
received message contains an even numlier of I's. 
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For a single unrestricted iirror detection code, the complementing 
digit complements the sum of the information digits. A complcnienting 
digit is a <'hcck digit. In the Idiiaiy cawc, it is a parity check digit. 

As an example, consider a decimal code of this type. A message 823 
would retjuire a complementing digit 7, making the total message 
8237 (8 + 2 + 3 + 7 - 20, a multiple of 10). An error in any one digit 
will mean that the sum of the message digits will not be a multiple of 10. 

For the small error case, it is sufficient to make certain that the sum 
of all digits is even since any error of ±1 would destroy this property. 
For the binary case, all errors arc small since the only possible error on 
any digit is a change by ±1 ; a simple parity check is adequate. I''or a 
non-binary code, it woukl be wasteful to add a digit just to make sure 
that the sum of all digits is e^en. In a decimal code for example, if the 
sum of the message digits is even, the values 0, 2, 4, 6, 8 for the check 
digit will satisfy a check, or if the sum of the message digits is odd, the 
values 1, 3, 5, 7, 9 will satisfy the check. More information could be 
sent if a choice among these values could be associated with informa- 
tion generated by the information source. 

This introduces the concept of a mixed digit ; i.e., a digit which conveys 
both check information and message information. 

A mixed digit is defined as follows: a mixed digit x, base h, is composed 
of two components (//, z) where ;/ represents an information component 
and z represents a check component. The number of information states 
of a mixed digit Is ^, with ij taking the values 0, 1, • ■ • , ,8 — 1 ; the 
number of check states of a mixed digit is a, the number base of z. 
In a message containing m check digits and /( mixed digits, the number 
of check states for the message is h"'-ai-a->- . . . -au , where a, is the 
number of check states of the 7''th mixed digit. 

If mixed digits are used as part of a code, information must be avail- 
able in at least two number bases; b, the number ba.se of the channel, 
and /S, the luunber base of the mixed digit. A situation where this arises 
naturally is in the case of the algebraic sign of a number; this is a digit 
of information, base 2, which may be associated with other digits of 
any base. Similarly, any identification which must be associated with 
numerical information can be conveniently coded in a number ba.se 
different from the number base of the numerical information. Thus, a 
mixed digit can sometimes be used conveniently in an information trans- 
mission system without complicating the information source and re- 
ceptor. 

All error detection code for single small errors suggests the use of a 
mixed digit. In the decunal code for example, the (|uibinary'^ representa- 
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Table II — Quibixaky Code 
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3 
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4 
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4 


1 


9 



tion of the mixed digit might be used, letting the quinary component of 
the mixed digit convey information and the binary component a check. 
(Table II.) 

The information source generates blocks of decimal digits followed by 
one quinary digit. The messages arc then generated in the following 
way: record all decimal information digits as information message digits 
and take their sum; if the sum is even, the binary component, z, of the 
mixed digit is 0, otherwise it is 1 . The quinary component, ?/, of the mixed 
digit is taken directly from the information source and combined \vith 
the calculated binary part by the rules of the quibinary code to form 
the mixed decimal digit. Thus, x, the value of the mixed digit, is given 
by the formula : 



X = 2(/ + 2. 



(1) 



For example, if the decimal digits of a message are 289 and the quinary 
digit of the message is 3, the mixed digit is 7, and the message is 2897. 
The sum of the decimal information digits is 19, which is odd, so that 
the binary component of the mixed digit is 1 ; this is combined with the 
quinary component, 3, by the rules of the quibinary code table, to form 
decimal digit 7. The requirement that the sum of all digits be even is 
satisfied by the binary component of the mixed digit, and the informa- 
tion associated with the mixed digit is contained in the (|uinary com- 
ponent. 

This method is easily extensible to any other number base and is also 
extensible to the case of slightly larger but still restricted errors (such 
as ±1 or ±2), provided that the maximum single error is less than 
(& - l)/2. 

From the preceding example, it is apparent that mixed digits can be 
usefully employed in error detection codes. The use of mixed, check and 
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information digits simplified the encoder and decoder. To differentiate 
among the classes of codes which will be described in this paper, the 
following terms will be used, in addition to those previously defined. 

A semi-systematic code encoder produces messages containing only 
information, mixed and chock digits. The information source generates 
information digits in ba.se b for information digits, and in base /3 for 
mixed digits. (The example given above is a semi-systematic code.) 

Of two coding schemes in the same channel base /), each working with 
messages of the .same length, and each satisfying a given error detection 
or correction criterion, the more efficient scheme is defined as the one 
which produces the larger number of different possible messages. 

III. SINGLE ERROR CORRECTION CODES, SMALL ERRORS (±1) 

The problems of error correction codes in nonbinary systems are ex- 
tensive and must be treated in several distinct sections. The basic differ- 
ence between the error correction problem in binary and non-binary 
codes is the fact that the sign of the error is important. In a binary 
code, if the message 11 is received and it is known that the second digit 
is incorrect, only one correction can be made, to 10. But in a decimal 
code w^ith errors limited to zfcl, if the message 12 is received and it is 
known that the second digit is wrong, it can be changed to either 11 or 13. 

Consider the following simple code for correcting single small errors. 
A decimal channel is used, and a message is eompo.sed of three informa- 
tion digits and one check digit. Let zi represent the check digit and X2 , 
.Ts, Xi the information digits. Here, .Ti is cho.sen to satisfy* 

.ri + 2.ro -h 3.1-3 + -ixi - mod 10. (2) 

The encoder calculates .ri , and transmits the message .T1.T2.r3.r4 . This is 
received as x/x/x/xt'. The decoder then calculates c given by 

c = (aV + 2x2' + 3.r/ + 4.1-4') mod 10. (3) 

If the assumption is made that at most a single small error exists, then 
this error can be corrected by using the following rules, which may be 
verified by inspection. 

If c = 0, no coi'rection is ne(^essary; 

5 > c > 0, decrease the cth digit by one; 

* By definition a = r moil h is equivalent to n = c + nh, where a, h, c and n 
arc integers. The equality notation i.s u.sed in preference to the congruence nota- 
tion tliroiighoiit this [lapor, since an addition performed without carry occurs 
naturally in many rircuits; in terms of such a circuit, the mod b signifie.s only the 
base of the addition, and a true equality exist.s between the state of two circuits, 
with the same output even though one has been cycled more often. 
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5 < c, increase the (10 - c)th digit by one; 

c = 5 implies a multiple error or a larger error. 

Since the value of c is used for correcting a received message, it is 
called the corrector.* For the general case, a corrector is defined as 
follows. 

In a message encoded to satisfy m separate checks, the result of cal- 
culating the checks for the received message at the decoder is an m digit 
word called the corrector. There are as many possible values of the cor- 
rector as there are check states of the message, although all of the 
values of the corrector need not correspond to a correctable error. 

It is important that, for a given transmitted message, every different 
error will lead to a different value of the corrector; otherwise there will 
be no way of knowing which correction corresponds to a particular value 
of the {corrector. The number of eorrectalile ei-rors may be far less than 
the number of possible \alues of the corrector, so that not all of these 
values may be useful for a code to correct a particular class of errors. 
However, the number of corrector states sets an upper hmit to the num- 
ber of possible corrections. 

For many codes, it is convenient to associate a particular value of a 
corrector for the condition that a particular digit has been received too 
high by a single increment, for example, a 7 received as an 8. 

The characteristic of a digit for a particular code is defined as the value 
of the (^ori-ector if that digit is incorrectly received, the error having 
increased the vAne of the digit by +1, and all other digits are correctly 
received. Obviously, this definition only applies to those codes havmg the 
property that the value of the corrector is independent of the value of the 
incorrect digit and of the other digits. 

A simple characteristic code encoder produces messages in which each 
digit has a distinct characteristic as defined above. 

The Hamming code is an example of a simple characteristic code as 
is the code pre\iously described. In that example, the characteristic of Xi 

is i. 

The ad\'antage of a simple characteristic code for single small error 
correction is obvious: the association between the calculated checks 
and the correction to be performed is simple and does not depend on the 
values of the digits of the message. 

The following example of a simple characteristic code will illustrate 
this prin(!iple more fully. 

Considei- a single small error correction code, working with a quinary 

•The lernis coiTCclor iiiul characteri.sLic were first used in !i more restricted 
sense in iin article on Ijiniiry coding by Golay.* 
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(base 5) channel. Each message will consist of ten information digits 
and two check digits. 

Let .1-1 and ;r2 represent the check digits, and Xz , Xa , ■ ■ ■ , Xn represent 
the information digits. 

The equations for calculating Xi and X2 are: 



lo^i + Qxn + Oxs + 1.1-4 + 1x5 + la-8 + la-7 

+ 2x8 + 2x9 + 2xio + 2xn + 2xvi = mod 5, 
Oxi + 1x2 + 2.1-3 + IXi + 2;C5 + 3.-C6 + 4x7 

+ 0.T8 + Ixg + 2.1:10 + 3xu + 4xi2 = mod 5. 



(4) 



(5) 



At the decoder, the corrector terms, Ci and C2 , are calculated using x/, 
the received value of .t, , in the following formulas: 



Ix/ + 0.r/ + O-r/ + 1x4' + 1x5' + Ixe' + Ix/ 

+ 2x8' + 2x9' + 2xit' + 2xn' + 2x12' = c, mod 5, 
Ox/ + Ix./ + 2x-/ + 1x4' + 2x5' + 3x6' + 4x/ 

+ 0.r3' + Lrg' + 2xio' + 3xii' + 4x12' = c. mod 5. 



(6) 



(7) 



The values of ciCo corresponding to the condition that one and only 
one digit is too high l)y 1, x,' ^ x. + 1, can be read by reading the coeffi- 
cients of the ith. digit in the corrector formulas. This quantity is therefore 
the characteristic of the ith digit. If x/ = x, — 1, then the fives com- 
plements of these coefficients will be the value of the con-ector. Tabic III 
lists the characteristics and characteristic complements associated with 
each digit. 

Table III — Characteristics and Characteristic Complements 
Systematic Quinary Code 



Digit 


Characteristic 


Complement of Characteristic 


Xi 


10 


40 


Xs 


01 


04 


X) 


02 


03 


X| 


U 


44 


Xi 


12 


43 


X| 


13 


42 


X7 


14 


41 


Xg 


20 


30 


Xs 


21 


34 


Xio 


22 


33 


Xii 


23 


32 


X12 


24 


31 
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In this code all the possible values of CiCj correspond to the charac- 
teristic of a digit or the complement of this characteristic, except 00 
which corresponds to the correct message. {An inspection of equations 
(4) through (7) reveals that if x/ = Xi for all values of i, the values 
of Ci and c-i are 0). Thus, we can assign a unique correction to each 
value of C1C2 . 

The above techniques are extensible to other number bases and dif- 
ferent length words provided h, the number base of the channel, is 
greater than 2. (The equivalent binary channel problem has been treated 
by Hamming. ) The following set of rules and conventions may be 
used for deriving a satisfactory set of characteristics for a simple charac- 
teristic systematic code used to corre(^t single small errors for any length 
message, and any liase, b ^ 3. The rules must he followed, and the 
conventions (which represent one pair of conventions out of the set of 
pairs of conventions, which together with Rules 1 and 2 can be used for 
deriving a code of this class) if followed, will lead to a reasonably simple 
method for encoding and decoding messages.* Since the rules, not the 
conventions, limit the efficiency of the code, no set of conventions can 
be found which will lead to a more efficient code of this class. 

Rule 1 . For an n digit message (including check digits), m check dig- 
its are required and m must satisfy the following inequalities: 

if b is odd, — ^^ - S n, (8a) 

if b is even, ^ n. (8b) 

Rule 2. No characteristic may be repeated; i.e., each digit must have 
a characteristic diffei'ent from that associated with any other digit. 

Convention 1. The various digits of a characteristic are arranged in a 
set order; i.e., C\i , C-n , ■ ■ ■ , (?„,, . The first digit which is neither zero, 
nor (in case b is even) 6/2, must be less than b/2. There must be at least 
one such digit. 

Convention 2. The characteristic of the jth check digit has a 1 in the 
jth position and O's elsewhere. 

Rule 1 is reciuired since, for a code of this type, we must be prepared to 
correct any digit in one of two ways (±1). This implies a minimum of 
2 n -J- 1 values of the corrector, one for each possible correction, and one 
for the ca.se of no corre(^tions. This means that b'", the number of possible 



* The jiljove cli.stiiiction between rules and conventions will be observed 
throughout this paper. 
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values of the corrector, must be at least 2 n + 1, equation (8a). For 
even bases, we must reject all values of the corrector containing only 
the digits and hi"! for representing error conditions for the following 
reasons; a positive error leads to a corrector that is the characteristic of 
the uicorrectly received digit, and a negative error leads to the 6-eoni- 
plemcnt of such a characteristic. In order to have unique error correc- 
tion, we must be able to distinguish between these two conditions. If a 
characteristic were to contain only the digits andb/2, it would be equal 
to its own b-complement ; such combinations of digits are therefore not 
useable as characteristics or characteristic complements. 

Rule 2 is required to permit a unique identification of an incorrect 
digit in ease of a single error. 

Convention 1 allows us to distinguish between positive and negative 
errors. By observing this convention, a characteristic (corresponding to a 
positive error) can be distinguished from its complement (corresponding 
to a negative error) by inspecting the first digit of a corrector which is 
neither nor fa/2. A characteristic mil have this digit less than b/2, 
a characteristic complement will have this digit greater than b/2. If 
the corrector is a characteristic, the correction is mnius one; if it is a 
characteristic complement, it is plus one. 

Once the characteristics have been chosen, the corresponding encoding 
procedure may be performed in the following manner: Let Oi, represent 
the jth digit of the characteristic of information digit .t, . Let z^ represent 
the check digit which has a characteristic containing a 1 in the jt\\ 
position. If convention 2 has been observed, (9) can be used to cal- 
culate Zj : 

n— m 

5^ a^Xi = —Zj- mod h. (9) 

1=1 

An encoder calculates each Zj and inserts it into the message in those 
digit positions which have the characteristic of the ;;th check digit as- 
signed to them. 

In more general terms, we use implicit relations that are equivalent 
to the exphcit equations given by (9). Letting .-r,- represent an informa- 
tion or a check digit, and letting C,j represent the jth digit of the charac- 
teristic of the ith information or check digit, these formulas may be re- 
written as 

Y, C^jXi - mod b. (10) 

i=l 

At the receiver, the decoder calculates m different check sums. Let Cj 
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represent the check sum corresponding to the ^th corrector term, and 
Xi represent the received value of xi : Then, 

^ CijXi' = Cj mod h. (11) 

The difference between equations (10) and (11) is the result of any 
mutilations caused by the channel. If no error has occurred, all the c/s 
are ; if an error of ± 1 has occurred, the m Cj's will form the characteristic 
or the characteristic complement, respectively, of the incorrectly re- 
ceived digit. 

One disadvantage of a systematic code is the discontinuity in the 
number of check states as a function of m, the number of check digits. 
For example, in decimal code one check digit is required for a message 
of up to four digits, and two check digits for up to forty-eight digits. 
Obviously, for a message of intermediate length, for example, twelve 
digits, many of the corrector states cannot be used for single error cor- 
rection since they will not correspond to any single error. A more effi- 
cient code would be obtained if the check states were limited to a smaller 
number. 

One method of reducing the number of check states is to perform the 
check in a different modulus than the modulus of the channel. In the 
single error detection code using a mixed digit, binary check mforma- 
tion and quinary message information was conveyed by this digit. This 
code was more efficient than a systematic code because each message 
contained the minimum number of check states which is 2. 

If a mixed digit, x, is composed of the two components (y, z) where y 
is the information state of the digit and z the check state, it is conven- 
ient to combine these two components to form x by means of the formula 

X = ay -\- z. (12) 

We calculate z by using a linear congruence equation modulo a. 

The use of this formula permits a decoder to act on x' , the received 
value of x, directly, without first resolving x' into y' and 2', because (12) 
insures that x' = y' mod a. This permits x' to be corrected directly and 
then resolved into its components. 

As an example, consider a semi-systematic code for correcting a single 
small error in a decimal system, using a twelve digit message; ten of the 
digits are information digits and two are mixed digits, each conveying 
binary message information and quinary check information. (One of 
these binary digits might represent the sign of the number.) 

With two quinary checks, twenty-five different check states are pos- 
sible; for correcting single small errors in a twelve digit message, twenty- 
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Table IV — Characteristics and Characteristic Complements, 
Semi-Systematic Decimal Code 



Digit 


Characteristics 


Characteristic 


Complements 


X| (mixed digit) 


1 





4 





X; (mixed digit 





1 





4 


X,i 





2 





3 


\i 


1 


1 


4 


4 


Xs 


1 


2 


4 


3 


Xfi 


1 


3 


4 


2 


X; 


1 


4 


4 


1 


Xg 


2 





3 





Xs 


2 


1 


3 


4 


Xiu 


2 


2 


3 


3 


^11 


2 


3 


3 


2 


X!2 


2 


4 


3 


I 



five corrector states are required, one for each of the two possible cor- 
ret'tions (±1) for each digit, and one for the case of a correctly received 
message. Characteristics may be chosen for the various digits in accord- 
ance with the rules and conventions outlined above in this case, since 
the check modulus is the same for both check digits. Consequently, it 
is no accident that these characteristics, shown in Table IV, are the 
same as those shown in Table III. 

Let C'ii and C.2 represent the characteristic of the ith digit, and let 
iji and y-2 represent the two binary information digits. Then: 



JL CiiXi = -zi mod 5, Xi = 2] + 5y, 



i-3 
u 



H Ci2Xi = -22 mod 5, .1-2 = 22 + 5?/2 . 



(13) 



(14) 



Because xi = z\ mod 5 and x-i = 22 mod 5, these relations can be re- 
written implicity to resemble equation (10): 



S Ci\Xi = mod 5, 

i-l 
H 

X C'.3.r, - mod 5. 
1=1 

At the decoder, the corrector C1C2 is calculated by: 

12 

S Ci\xl = Ci mod 5, 
t=i 

12 

X] C'la^'i' = C2 mod 5. 



(15) 
(16) 

(17) 
(18) 
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If the corrector is 00, the message has been correctly received ; other- 
wise, the corrector is either the characteristic or characteristic comple- 
ment of the incorrect digit, from which plus one or minus one respec- 
tively must be subtracted as a correction. 

Consider the general case. Let xi , x^ , ■ ■ ■ , Xt represent the/.- informa- 
tion digits; 1/1,1/2, ■ ■ ■ , i/m represent the information state of the m 
mixed digits, and 21,^2, ■ • ■ , Zm represent the check state of the m 
mixed digits. In addition, let ai , aa , • • ■ , o^ repre.sent the number base 
of Zi , 22 , ■ ■ ■ , 2m respectively; j3i , /32 , ■ • • , ^m represent the number 
of possible .states of iji , ys , ■ • ■ , ym respectively, and Xk+i , xj+a , ■ • • , 
Xk+m represent the values of the mixed digits after the message has been 
encoded. {Note that for simplicity, a check digit is considered as a special 
case of a mixed digit; its information state is permanently 0.) The follow- 
ing encoding procedure may be used in which Xi , x-i , • ■ ■ , Xk arc used 
directly as part of the transmitted message. This is a semi-systematic 
code, which means that information digits are not changed in coding. 
To derive the mixed digits, the following formulas are used: 

anxi + ■ ■ ■ + au-Xk = —Zi mod ai (19-1) 

X(k+j) ^ yiai -{- zx (20-1) 

dviXi + ■ ■ ■ + a-ikXk + a2(t+i).'r(t+i) = -^a mod a. (19-2) 

a.'(ji+2) ^ yioi^ H- 22 (20-2) 



ai\X). + ■ ■ ■ + a^kXk + • ■ • + aj(A-+j-i).r(t-+j_i) 

^ —Zj mod oLj (19-i) 

2(H-j) ^ yj«; + ^j (20-j) 

am\X\ -(-■■■+ dmkXk + ■ ■ • + amu+«j-i)a:cAH-™-i) = ~^r» mod «„, (19-m) 

a^cfc+™) ^ Vi-am + S". • (20-m) 

In each case, the value of the check component 2>, of a mixed digit 
.T(i+» is determined by a formula invoh'^mg the information digits and 
previously calculated mixed digits. Immediately after 2j has been de- 
termined, .r(A-+ji is calculated for possible use in calculating 2(j+i) . 
After the message has been completely encoded the foUomng equations, 
analogous to (10), will be satisfied. 
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Let Cij represent ay; in equation {19-j). Tlien, 

y) CijXi = mod aj . (21) 

(Since X(_k+}) ^ 2/ mod a; , substitution of X{k+j) for zj in equation (19-j) 
will continue to satisfy the equation.) 

At the decoder, equation (21) is changed to 

k+m 

S Cijx/ = cj mod aj (22) 

In (22), x/ represents the received value of Xi , and c,- represents the jth 
digit of the corrector. If all the digits have been correctly received, i.e., 
x/ = Xi for all values of i, then Ci ^ C2 = ■ ■ ■ = c,„ ^ 0; [see equation 
(21)]. If Xh had been received incorrectly so that xn = a;/, + 1, but all 
other digits had been correctly received, then the value of c_,- (the ^'th 
digit of the corrector) would be calculated in the following manner: 

k-hn 

Cj mod Oj ^ ^ CijXi' 



t=i 

k+m 

c 



'■j mod aj ^ 2I1 CijXi -\- Chi = Chj (23) 

1=1 



Equation (23) proves that Chj is actually the Jth digit of the charac- 
teristic of Xh , because by definition, the characteristic of Xh is the value 
of the corrector when Xh = Xk -\- I, and all other digits have been cor- 
rectly received. This means that thegeneral term, C,y of (21), is actually 
the ,-/th digit of the characteristic of the ith digit and that this is a simple 
characteristic code. 

For the case that Xh ^ Xh — 1, the value of the corrector is such that 
if it were incremented, digit by digit, by the characteristic of Xh , the 
corrector would be composed only of zeros. Incrementing the corrector 
by the characteristic of Xh is equivalent to recalculating the corrector 
with Xh increased by one, which m this case would amount to calculat- 
ing the con-eetor for the case of a correctly received message. The 
latter is composed of all zeros [see (21)]. Thus, for the case of a single 
error of — 1 , the corrector is the characteristic complement of the digit 
which is incorrectly received. For a semi-systematic or systematic code, 
the characteristic complement is an m digit word whose jth digit is the 
complement modulo aj of the jth digit of the characteristic. 

Equation (20-j) shows that generally aj^j cannot exceed h. (An ex- 
ception is given below.) The maximum value of yj is 0j — 1 since y is a 
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digit in the number base /3j . The maximum value of Zj is usually ay — 1, 
since Zj is a digit in the number base aj. Thus, 

Xk^i - ijiaj + 2j ^ & - I , (24) 

(/3y- ])«, + «;- 1^6-1, (25) 

«i/3y g h. (26) 

Equation (24) restates (19-j), and also states that the maximum value 
of any digit .-c, is ^ — 1, where h is the number base of the channel. In 
(25), the maximum values of y; and Zj are substituted to yield the result 
shown m (26). 

It was stated above that the maximum value of Zj is usually aj — 1. 
An exception occurs only in case Zj checks only itself and other mixed 
digits, the latter being restricted to fewer than b — I states. Under such 
circumstances, the value of z is sometimes restricted, so that even though 
z is calculated to satisfy a check, modulo a; [see equation (19-j)], it can- 
not assume a, — 1 values. For example, a code for transmitting a 
single digit message over a decimal channel and permitting the correc- 
tion of small erroi-s, might use as the set of transmitted messages the 
digits, 0, 3, 6, 9. In this case, a ^ 3 (any correct message satisfies the 
check X = mod 3) and /3 = 4 smce four different messages may be 
transmitted. In this case, z is restricted to the value because the mixed 
digit checks only itself. 

In order to correct single errors of ±1, using a simple characteristic 
code, it is necessary and sufficient that every characteristic be different 
from every other characteristic, and that it also be different from the 
complement of every other characteristic. 

The following rules and conventions may be used to derive a set of 
characteristics which meet the requirements for a simple characteristic 
semi-systematic or systematic code for correcting small errors for any 
base b ^ 3 and an arbitrary length message. No set of conventions can 
be found which will lead to a more efficient code of this class, since the 
rules, not the conventions limit the efficiency of the code. 

Rule 1. For an n digit message, including mixed digits, containing m 
mixed or check digits of which mi are associated with an even modulus, 
a, the inequality 

(ara2- ... ■«. -2"'i)/2^ n (27) 

must be satisfied. 

Rule 2. No characteristic may be repeated, i.e., each digit must have 
a characteristic different from that associated with any other digit. 

Rule 3. Since the mth check is the last one to be calculated, and the 
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characteristic of the mth mixed digit must therefore contain only a single 
digit which is not 0, a„, must be greater than 2. 

Convention 1. The various digits of a characteristic are arranged in a 
set order, i.e., C,i , C;« , ■ ■ • , C,™ . The first digit which is neither nor 
aj/2 must be less than aj/2. There must be at least one such digit. 

Convention 2. The characteristic of the jth mixed digit has a 1 in the 
jth position and O's elsewhere, provided that aj ?^ 2. If a; — 2, the char- 
acteristic of this mixed digit has a 1 in the^'th and mth positions, and O's 
elsewhere. 

Rule 1 is required because the number of possible corrector states is 
a\-a%- .,. • Om , of which only those containing at least one digit which 
is neither nor a/2 can be associated with the 2n possible errors. The 
same reasons used for Hule 1 for the systematic code case are equally 
applicable here; a characteristic containing only the digits or aj/2 in 
the jih position is not distinguishable from its complement. 

Rule 2 is required to permit a unique identification of an incorrect 
digit. 

Rule 3 is necessary to derive the sign of an error on the m\h mixed digit. 

The reasons for using Conventions 1 and 2 in the case of the sys- 
tematic code are eciually appHcable in this case. For the case a = 2, 
however, a special convention must be used to avoid a conflict with 
Convention 1 . 

The procedure for converting a set of characteristics into an error 
correcting code system is the same for a semi-systematic code as for a 
systematic code except that the following additional functions must be 
performed: the encoder must combine check states with information 
states to derive mixed digits, and the decoder must resolve mixed digits 
into information and check digits after it has performed its corrections. 

By using these rules and conventions, the most efficient simple charac- 
teristic code can be determined. For messages of length n (including 
mixed or check digits), the following relations must be satisfied: 

Let 

P = ai-a2- ... -a,,, , 

Q ^ ^,-&,- ... -0^, 

mi ^ number of even a's. 

Then: 

(P - 2"'0/2 ^ n, (28) 

a,-0i S b, (29)* 



For exceptions, see above. 
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Table V^ Decimal Error Correction Codes 



M 


P 


Q 


ai , 15 , ... 


ffi,0t. ... 


2n+ 1 


1 


3 


2.5 


3 


4 


3* 


2 


5 


5 


5 


2 


5 


3 


10 


10 


10 


1 


7 


4 


10 


10 


10 


1 


9 


5 


15 


16.7 


5, 3 


2,3 


U 


6 


15 


16.7 


5, 3 


2, 3 


13 


7 


15 


16.7 


5, 3 


2, 3 


15 


8 


20 


20 


10, 2 


1,5 


17 


9 


25 


25 


5, 5 


2, 2 


19 


10 


25 


25 


5, 5 


2, 2 


21 


11 


25 


25 


5, 5 


2, 2 


23 


12 


25 


25 


5, 5 


2, 2 


25 


13 


30 


33.3 


10, 3 


1, 3 


27 


14 


30 


33.3 


10, 3 


1, 3 


29 


15 


40 


40 


10, 2, 2 


1, 5, 5 


31 


16 


40 


40 


10, 2, 2 


1, 5, 5 


33 


17 


50 


50 


10, 5 


1, 2 


35 


la 


50 


50 


10, 5 


1, 2 


37 


19 


50 


50 


10, 5 


1, 2 


39 


20 


50 


50 


10, 5 


1, 2 


41 



* The single digit message containing the points 0, 3, 6, 9 is an exception to 
the inequality a^ ^ 6, because the mixed digit checks only itaelf. 

For the most efficient code h"'/Q should be minimized. This term repre- 
sents the ratio of the number of possible messages for an n digit message 
with and without error correction. This is normally at least as great as 
2n + 1, the number of possible corrections on such a message. 

Tabic V shows the most efficient decimal codes of this type for an n 
digit message, for values of n from 1 to 20. Where two or more different 
codes are equally efficient, the code with the fewest mixed digits is shown. 
It is easy to convert from a code using two mixed digits with ai = 5, 
a2 = 2, to one usmg a check digit with a ^ 10, or to make the mverse 
conversion, and to show that both codes are equally efficient. 



IV. SINGLE ERROR CORRECTION CODES, UNRESTRICTED ERROR 

The problem of correcting an imrestricted error on one digit of a 
message must be di^'ided into two categories, depending on whether h 
is a prime number or a (composite number. As will be seen, the error 
correction problem for prime bases is considerably simpler than that for 
composite bases. The method for correcting errors in prime number 
systems was discovered by Golay," although this did not come to the 
author's attention until after he had worked out the same method. The 
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adaptation to non-prime channel bases is believed to be novel. Since the 
adaptation makes use of the code for prime bases, both will be described. 

4.1 Prime Number Base, Single Unrestricted Error Correction Code 

This code depends upon a fundamental property of prime numbers, 
well known in number theory.^ Let p represent a prime number and d, 
c, and w represent non-negative integers less than p, related by the 
expression : 

dw = c mod p. (:iO) 

li d ^ 0, then d and c uniquely determine w. 

In order to have a simple characteristic systematic code for correcting 
unrestricted errors, it is necessary and sufficient that the set of charac- 
teristics shall have the property that all multiples of all characteristics 
are distinct. Equation (30) implies a unique correspondence between mul- 
tiples of a characteristic and the characteristic itself, if we consider c to 
be the multiple, d the multiplying factor and w a digit of the charac- 
teristic. An error, d, is simply identifiable if a known digit of a charac- 
teristic is always 1 . If each characteristic is distinct from every other and 
if a sufficient luimber of check digits are available, a simple characteristic 
code can be obtained. In the following set of rules and conventions which 
may be used for deriving a set of characteristics for a simple charac- 
teristic systematic code for correcting single unrestricted errors, p repre- 
sents the prime number base of the channel. The number ba.se of the 
channel must be prime, and the length of the message is arbitrary. Since 
the rules and not the conventions limit the efficiency of the code, no other 
set of conventions may be found which will lead to a more efficient code 
of this class. 

Rule 1. For an n digit message, m check digits are required and m 

must satisfy the iiiequality 

lit -I 

n ^ ^^. C^l) 

p - 1 

Rule 2. Each digit must have a different characteristic. 

Convention 1. The digits of a characteristic are arranged in a set 
order, i.e., Ciid-2 • ■ ■ C,,„ . The first digit which is not must be 1. 

Convention 2. The characteristic of the jth check digit has a 1 in the 
jth position and O's elsewhere. 

Rule 1 is retiuired for a code for correcting single unrestricted errors 
since any digit must ha correctable in one of p — 1 ways. This implies 
a minimum of 7i{p — 1) -|- 1 states for the corrector, one for each cor- 
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rection and one for the correct message. When m check digits are used, 
p"" corrector states are obtained. 

Rule 2 and Convention 2 are the same for the single small error cor- 
rection systematic codes. The same reasons apply for both ceases. 

Convention 1 is changed from the equivalent convention for the small 
error correction code, because the magnitude of the error, not only its 
sign, must he derivable for a code for correcting single unrestricted 
errors. 

An encoder first encodes the message according to (82), where dj 
represents the jth digit of the characteristic of .x; , 

X; CijXi - mod b. (32) 

The decoder calculates the corrector using the following formula where 
Xi represents the received value of Xi ; 

XI CijXi ^ Cj mod b. (33) 

The decoder then examines the digits of the corrector in order. The 
first digit which is not shows the magnitude, d, of the error. All digits 
are then divided by d (provided d ^ 0). (That division is unique, as 
shown by (30).) The result of this division is the characteristic of the 
incorrect digit, which is then corrected by subtracting d. 

Consider a code for correcting a single unrestricted error in a six digit 
message for a base 5 channel: 

6 g ^1^, (34) 

4 

A value of 2 for m will satisfy equation (34). The characteristics are 14, 
13, 12, 11, 10 and 01, the last two being check digit characteristics, for 
Xi, Xi, X3 , xa, Xb, and x^ respectively. Here, xj , Xi , .ts , and 0:4 are in- 
formation digits. The encoding formulas are: 

■I'l + Xi + X3 + xi ^ —Xf, mod 5, (35) 

4.ri -1- 3.1-2 + 2.r3 + .T4 ^ -Xt mod 5. (30) 

The decoding and correcting formulas are: (x/ is the received value of 

Xi) 

Xi + X2 + X3 -\r Xi + Xb' = Ci mod 5, (37) 

W + 3.^2' + 2x3' + Xi' + .Ta' = C2 mod 5. (38) 

The corrector is C1C2 . 
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Suppose that a message 221321 is received as 224321. Then: 

ci - 13 = 3 mod 5, (39) 

c, - 26 - 1 mod 5. (40) 

To find the characteristic of the digit, Xh , that was incorrectly received 
from the value of the corrector, (41) and (42) must be solved: 

d Chi = Ci = 3 mod 5, (41) 

d Ck2 = C2 ^ 1 mod 5. (42) 

Because the first non-zero digit of any characteristic is 1, (41) can be 
solved for d since Chi = 1- This yields the result, d = 3. Using this result, 
(42) is solved for Chz ; by inspection, Ch-i = 2, since 3-2 — 6^1 mod 5. 
Thus the characteristic of the incorrect digit, Chi Chi , is 12, and the 
error d, is 3; x/ must therefore be reduced by 3 to get the correct value. 
Since the message was received \vith x^' too high by an amount 3, this 
result confirms our expected correction. 

Any correction that is applied must be applied on a modulo 6 basis. 
For example, if a correction of —2 is indicated on a digit whose re- 
ceived value is 1, 1 — 2 = 4 mod 5, which means that the digit is cor- 
rcM^tcd to 4. 

Codes of this type are restricted in their construction. No mbced digits 
may be used, and the number base must be prime. For the case of 
'11 = [{p° — l)/(p — 1)] + 1, S + 1 check digits are required [see (31)]. 
This means that the number of information digits for a message of 
this length is the same as for a message one digit shorter, which requires 
only g check digits. A comparable binary case is the Hamming Code 
example of an eight binary digit message (four information digits) 
compared with a seven digit message (also four information digits). In 
the binary case, the extra digit is useful for double error detection, but 
unfortunately, this is not the case for non-binary codes. 

4.2 Composite Number Base, Single Unrestricted Error Correcting Code 

The problem of correcting an unrestricted error on a single digit, 
working with a number base b, that is not a prime is much more difficult. 
Many relatively inefficient techniques exist. For example, characteristics 
containing only binary numbers (0 and 1) might be used; (this would 
amount to using the Hamming Code directly). This is obviously ineffi- 
cient since the corrector associated with any single digit error of amount 
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d, would contain only the digits and d, thus wasting most of the pos- 
sible corrector values.* 

It is possible to encode and decode using the prime factors of the 
number base, performing separate and independent corrections on each 
factor. This is also inefficient, since for many cases, information as to 
which digit is in error is found independently in two or more ways, while 
for certain values of the error, it can be found in only one way. AVorking 
with mixed digits and check bases, a lower than 6, is not satisfactory 
since certain values of the error (a in particular) will never show up in a 
particular check. The technique used for primes will not work since 
multiples of two different characteristics may be identical; for example, 
base 10, characteristics 11 and 13, error 5, will both yield correctors of 55. 

Another technique . that is relatively efhcient is, however, available. 
It involves performing all check, encoding and decoding operations in a 
number base p, where p is some prime number (usually, the lowest) 
that is equal to or greater than b. (In case 6 is a prime, we use the pro- 
cedure outlined above, which is a special case of the procedure to be 
described below.) 

The obvious difficulty in such a procedure is that while the informa- 
tion channel can only handle b levels, the check digits may assume p 
levels, corresponding to the required p check states. This dilemma can 
be resolved by adding an adjustment digit. The object of this digit is to 
permit check information to be transmitted in a base greater than b, 
the channel base. The idea of an adjustment digit can best be illus- 
trated by an example. Supposefora decimal channel, checks are performed 
in a unodecimal (base 1 1 ) code. Let 7 represent the value corresponding to 
ten. (The consecutive integers in a unodecimal system are then 0, 1, 2, 
3, ■ • • , 9, 7, 10, 11, ■ ■ ■ , 19, It, 20, etc.) Suppose in a particular mes- 
sage, four check digits, zi , 22 , 23 , z.i , calculated modulo 1 1 from decimal 
information digits are used, whose values are 1, 0, 7, 8. A fifth digit, 
Zo is added such that the sums modulo 11 of 21 -f- zo , 22 + 20 , 23 + zn , 
24 + zo are kept constant at 1, 0, 7, 8 respectively. There are eleven dif- 
ferent words satisfying the condition: [1, 0, 7, 8] ^ [(21 + 2o), (22 + zo), 
(23 + 2o), (24 + 2o)]. These are sho^ra in Table VL Of these words, six do 
not contain the digit 7, and so may be transmitted over a detiimal chan- 
nel. Thus, an adjustment digit permits check digits which are calculated 
in a number system of a higher base than b, to be transmitted over a base 
b channel. When an adjustment digit is used in base p for adjusting m 
digits so that transmission over a channel in base b is possible, a mini- 



• A waste of corrector vahies is equivalent to an excessive number of check 
states for a message, which in turn implies an excessive number of check digits. 
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mum of b — in{p — b) states are allowed for the adjustment digit. (For 
certain values of the check digits, more states could be allowed, but a 
code for utilizing these extra states becomes unwieldy.) For the case 
b = 10, p ^ 11, this turns out to be 10 — m. At least one state must 
be available for each adjustment digit, to have a workable code. 

The characteristic of an adjustment digit is determined in the follow- 
ing way: if an adjustment digit adjusts the jth check digit, then the jth 
digit of the characteristic of the adjustment digit is 1; otherwise, it is 0. 
The characteristic of all other digits may be derived using the rules de- 
scribed above for the prime number base channel, except that p, the 
prime number base of the code must be used instead of b, the number 

Table VI — Illustration of Adjustment Digit 



Sa 


-1 


=- 


Z3 


u 





1 





y 


8 


1 





y 


9 


7 


2 


7 


9 


8 


6 


3 


11 


S 


7 


5 


4 


H 


/ 


6 


4 


6 


7 


6 


5 


3 


6 


a 


5 


4 


2 


7 


5 


4 


3 


1 


8 


4 


3 


2 





9 


3 


2 


1 


7 


y 


2 


I 





9 



base of the channel, for generating characteristics. A message is initially 
encoded using a value of for an adjustment digit. Subsequently, if the 
adjustment digit always has at least q allowable states, it may be used 
to transmit one additional information digit, base q, of information. If 
the value of this information digit is y, the {y + l)st lowest possible value 
of the adjustment digit (making the lowest value equivalent to y ^ 0) 
meeting the re((uiremcnt that all adjusted check digits are no greater 
than b — 1 is transmitted. The adjustment digit m conjunction with 
its associated check digits conveys a digit, base q, of information. 

In the example given above, g = G and if i/ is 4, the fifth lowest value 
of 2(1 , 7, is transmitted. The lowest value must be associated with y = 0. 
The values of zdZiZ^ZuZa that are sent over the decimal channel are 75431. 

An example of such a code is one using a decmial channel working in a 
unodecimal base for the purposes of encoding and error correction. The 
word length, n, is twelve, nine decimal information digits, one octal (base 
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Xi I7 


.1-5 10 


a;2l9 


a-fi 15 


XslS 


X, U 


.t4 17 


a-a 13 



8) information digit associated with the adjustment digit, and two check 
digits. The characteristics are the following : 

a-9 12 

a:io 11 (adjustment digit) 

a'li 10 (check digit) 

.T12 01 (check digit) 

Let zu and Zn represent the values of the check digits .Th and xn , 
originally derived from Xi , xo , ■ ■ ■ , a'g , a-g : 

a-i + a-2 + a-3 + ■ ■ - + ag = —Zu mod 11, (43) 

7-Ti + 9x0 + Saa + ■ ■ • + 2.r9 = -Zn mod 11. (44) 

From Zn and zn , the ten different words (0, Zn , Zn), (1, 2ii — 1, 212 — 1), 
(2, Zn - 2, Zn - 2), ■ • ■ , (9, 211 - 9, 212 - 9) are formed. If ij is the 
value of the octal information digit, the {y -\- l)st such word, that does 
not contain the digit 7, is selected and transmitted as the last three 
digits of the message. For example, if zn = 2, Zn = 1 and y = 6, the ten 
words are (0, 2, 1), (1, 1, 0), (2, 0, 7), G^, 7, 9), (4, 9, 8), (5, 8, 7), (6, 7, 6), 
(7, 6, 5), (8, 5, 4), (9, 4, 3); the word (8, 5, 4) is selected since it is the 
seventh in the sequence that does not contain any 7's- Table VII shows 
the choice of the three last digits as a function of ij, given Zn = 2,zn= 1. 
Formula (45) is used for calculating the corrector. Let dj represent 
the jth digit of the characteristic of Xt , cj the jth digit of the cor- 
rector, and Xi the received value of Xi . Then, 

12 
Ci = Y.CiiXi'mod 11. (45) 

The translation from corrector to correction is the same as if the original 

Table VII — Relation Between Adjusted Digit and 
Associated Information 



y 


Xta 


Xu 


X\l 








2 


1 


1 


1 


1 





2 


4 


9 


8 


3 


fi 


8 


7 


4 


6 


7 


6 


S 


7 


6 


5 


6 


8 


5 


4 


7 


9 


4 


3 
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message had been in a unodeciraal code. (This has been illustrated in 
Section 4.1.) 

The first step of the encoding procedure is to calculate the unadjusted 
check digits. Next, the adjusted check digits and adjustment digit are 
selected according to the value of y, the mformation digit associated with 
the adjustment. The message is then ready for transmission. 

At the decoder, the me.ssage is first corrected as if it had been re- 
ceived as a unodecimal message. The information digits are then in 
their corrected states. Next, the adjustment digit and the check digits 
are examined and the inverse of the encoding process used to select a 
particular set of check and adjustment digits is used to reconstruct the 
value of y which originally controlled the selection. In the example given 
above, the values of X\q , .Th , Xi-, are 8, 5, 4 respectively ; the decoder recog- 
nizes that this is the seventh lowest value of o^id , which means that the 
value of //, used in selecting xio and the adjusted vakies of .rn and Xn , 
was 6. 

The code described above is fairly efficient; about 90 per cent of the 
corrector values can be associated with corrections; the produ(^t of the 
information states and tlie check states is about 97 per cent of the 
total number of states of a twelve decimal digit word. Each of the above 
factors reduces the efficiency of the code below a possibly unattainable 
maximum. It will be noted, however, that this reduction is relatively 
small in both cases, and is very much lower than would be the case for 
any of the rejected schemes. The scheme is not difficult to in.strument; 
relatively little additional equipment is required in addition to the 
basic equipment for instrumenting a simple prime number base chan- 
nel, unrestricted single error correcting code system. 

The method of adjustment digits is general and can be used for de- 
riving a single error correction code for correcting unrestricted errors 
for any chainiel base. Any convenient prime check base, p, at least as 
great as h may he used, although the lowest will generally be the most 
efficient. The only requirements which must be fulfilled are that the 
number of states of the adjustment digit must be at least 1, and that at 
least two check digits must be as.sociated with each adjustment digit. 
An adjustment digit associated with m check digits, working with a 
channel base 6 and a check base p, may have h — m{p — b) different states. 

v. SINGLE EKROU COliRECTION, DOUBLE ERROR DETECTION CODES FOR 
CORRECTINfl SMALL ERRORS 

Single error correction, double error detection codes are very useful 
in situations where a message may occasionally be repeated. In order 
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for a correction code to be reasonably useful in a system with random 
noise or errors, the errors must be relatively infrequent, which makes 
double errors still more infrequent. If means are available for an occa- 
sional but very infrequent repetition of a message, a single error correc- 
tion, double error detection code will increase the reliability of a digital 
system, since a message may be repeated if a double error is recognized. 

This section will show how the ideas of the single error correction, 
double error detection Hamming Code may be combined with the ideas 
of semi -systematic single small error correction codes (described in Sec- 
tion III) to derive simple and efficient codes for cori-ecting single small 
erroi-s and detecting double small errors. 

In order to derive a simple characteristic code for correcting single 
small errors, and detecting double small errors, a set of characteristics 
must be found having the property that the sum or difference of two 
characteristics or their complements or double the value of one charac- 
teristic or its complement be distinguishable from the value of any 
single characteristic or its complement. The sum of two characteristics 
represents the value of the corrector for a message with two errors of 
+ 1, +1, the difference represents two errors of -M, -1, the sum of 
their complements represents two errors of —1, —1; double a charac- 
teristic represents an error of 4-2, and double a complement represents 
an error of —2. To have a true single error correction, double error de- 
tection code for small errors, all these cases must be distinguished from 
the case of a single error or no error by making certain that the value of 
the corrector for any of these cases is different than the value of the 
corrector corresponding to any single error and no error. 

Table VIII gives the characteristics used in the single error correction 
Hamming Code and the single error correction, double error detection 
Hamming Code for conveying four digits of information in a message 
containing seven or eight binary digits respectively. 

An inspection ot Table VIII shows that the sum (performed without 
carries from column to column) of any two characteristics in the right 
part of the table is distinguished by having at least one 1 in the first 
three places and a in the last place. This distinguishes it from any 
single characteristic since all characteristics have a 1 in their last place. 

Some difficuhies arise m trying to adopt such a scheme directly in a 
non-binary system. For the code to be efficient, an over-all check would 
have to be performed using a mixed digit; only two check states are 
required for an over-all parity check, and if (; > 3, (6 representing the 
number base of the channel) at least two information states are pos- 
sible. But the over-all check digit, which performs a binary check, is not 
checked by any other digit. This means that although errors might be 
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1,369 



detected in an over-all check digit, difficulties would be encountered in 
determining the direction of the correction, so that the information 
conveyed by the mixed digit could be used. Actually, means are avail- 
able, for accomplishing an adaptation of binary techniques. These meth- 
ods are described in Section VII but they are less straightforward than 
the ones described below. 

For channels with base b, greater than 3, at least one check may be 
made using a check base, a,,, , that is 4 or greater. If characteristics are 
used whose last digit (the digit associated with the a,„ check) is always 1, 
and whose only other limitation is that each characteristic is different 
from every other characteristic, a satisfactory code is obtained. Single 
errors are corrected in the normal way. If the last digit of the corrector 
is 1 or a,„ — 1, the error is ±1 respectively on the digit whose charac- 

Table VIII — Characteristics for Hamming Codes 



Single Error 
Correction 






Sinfilc Error 

Correction Doulile 

Error Detection 


001 
010 

oil 

100 
101 
110 

111 


Check Digit 
Check Digit 
Information Digit 
Check Digit 
liiformiition Digit 
Information Digit 
Information tJigit 
Over-all Check Digit 


X,i 
X4 
Xb 

Xfi 

Xt 

Xs 


0011 
0101 
0111 
1001 
lOll 
1101 

nil 

0001 



teristic or whose characteristic complement is indicated by the cor- 
rector. If the last digit of the corrector is 2 or «„ — 2, or the last digit is 
and other digits are not all 0, a double error is indicated. If the entire 
corrector is made up of O'.s, the message is correct as received. 

An example is a code for a ten digit message, decimal base chainiel; 
eight decimal information digits, one mLxed digit conveying binary 
message information {such as the sign of the decimal numljer) and qua- 
ternary (base 4) check information, and one check digit are transmitted 
in each message. Let Xi and a'a represent the mixed and check digit re- 
spectively, Xs through Xio the information digits, yi the binary informa- 
tion conveyed by Xi , and Zi the quaternary check information conveyed 
by .-ci . The encoding formulas are: 

2.1:3 + 33:4 + 4.T5 + 5x8 + Gx7 -t- 7xa + 8.X-9 + 9.rii, = -.-r. mod 10, (40) 

X2 -{- X3 -^ Xi -\- xi -\- X6 -\- xi -\- Xs + .Tg + .Tio = — 2i mod 4, (47) 

•■Ti = 2i -f 4j/i . (48) 
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Note that (40), (47) and (48) must be applied consecutively, in that 
order, since (47) cannot be applied without knowing X2 obtained from 
(46), and (48) requires Zi , obtained from (47). 

The characteristics are 01, 11, 21, 31, 41, 51, 61, 71, 81, 91 respec- 
tively; the complements of the characteristics are 03, 93, 83, 73, 63, 53, 
43, 33, 23, 13 respectively. The corrector, Cid , is calculated at the 
decoder by the following formulas {x/ is the received value of Xi): 

ci = i;(.i-/)(« - 1) mod 10 (49) 

C2 = E ^i mod 4 (50) 



Consider the example of a message with decimal information digits 
37520 52 and binary information digit 1. Then X2 = 3, zi = 3, 
and yi = 1, yielding a value of 7 for Xi . The message is sent as 7 3 3 7 
5 2 6 5 2. Suppose that the sixth digit is changed to 1 in transmis- 
sion. Then the corrector has a value 53; this is the complement of the 
characteristic of the sixth digit and indicates that the sixth digit should 
be mcremented by 1 according to the rules previously stated. If the 
sixth digit had been received as 1 and the seventh digit also received as 1 
(an error of +1), then the corrector value would be 10, indicating a 
double error (see rules stated above) . 

If a multiple of 4 is used as a™ , the last digit of a characteristic may 
assume all odd values below q:„,/2. The rule then is that an even value of 
the last digit of the corrector, or a for the last digit and other digits 
of the corrector not all 0, indicates a double error. 

The following set of rules and conventions may be used with any 
base b S 4, and any length of message, for deriving a set of charac- 
teristics for a semi-systematic code for correcting single small errors and 
detecting double small errors. Since the conventions restrict the efB- 
ciency of the code, it is conceivable that a different set of conventions 
will yield a more efficient code in some cases; (51) may be modified 
through the use of an alternate set of conventions. 

Rule 1. No two digits may have identical characteristics. 

Convention 1. Choose for a„, a multiple of 4. Let a,^/^ = g. 

Convention 2. The characteristic of the mixed digit associated with 
a„x contains a single 1 in the last position; the rest of its digits are 0. 

Convention 3. The characteristics of the jth mixed or check digit con- 
tains a 1 in the last position, a 1 in thejth position and O's elsewhere. 

Convention 4. The characteristic of an information digit has an odd 
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number less than a,„/2 in its last position. The rest of its digits are 
arbitrary. 

Convention 5. The alM)\'e fonventions restrict the choice of charac- 
teristics. In order to have n di.stinct characteristics^ m mixed or check 
digits, using check bases 0:1,02, ■ ■ ■ , a™ , are required, and inequality 
(51) must be satisfied: 

n ^ aia-i- ... -Oni^i-g. (51) 

Codes may be derived using the above conventions only if ?> ^ 4. 
For the ternary case, a relatively efficient code may be obtained by 
using one ternary digit as an over-all parity check digit. The rest of the 
message is in a single small error correction code, deri\'ed using the 
rules and conventions of Section III. Any single small error will lead to a 
failure of the parity check, and a double small error will lead to a failure 
of other checks but not the parity check. 

No general solution has been found for deriving an efficient single 
error correction double error detection code for the unrestricted error 
case. Also, no general solution has been found for deriving an efficient 
multiple error correction code for the unrestricted error case. A reason- 
ably efficient method has been found for correcting multiple errors in 
the more important small error case; this is discussed in Section 6.2. 

VI. THE USK OF BINARY ERROR CORRECTION TECHNIQUES IN NON-BINARY 

SYSTEMS 

In this section, methods for using binary codes for the correction of 
errors in a non-binary system are described. Although the single small 
error correction codes obtained in this manner are generally less flexible 
than the codes obtained in Section III, the class of multiple error correc- 
tion codes described in Section 6.2 is the only reasonably satisfactory 
class of such codes that has been fomid. The codes described in this 
section are semi -systematic but are not simple characteristic codes. 

6.1 Single Small Error Correction Codes 

Binary codes are most conveniently used for correcting small errors 
(±1). Suppose any digit, base h, has an associated pair of binary digits, 
arranged in such a way that a change of ±1 in the base b digit will 
change only one of the two binary digits. For 6 ^ 10, an association 
such as the one shown in Table IX might be used. For example, if a 
6 is received as a 7, the a.s.sociated binary message would indicate 
that the second of the binary digits is incorrect; a 7 can be corrected 
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Table IX — Associated Binary Digits for Correction 
OF Small Errors 



Decimal Digit 


Associated Binary Digits 





00 


1 


01 


2 


n 


3 


10 


4 


00 


6 


01 


6 


11 


7 


10 


S 


00 


9 


01 



Table X — Reflected Qtiibinary Code 



Decimal Digit 


Quinary Component 


Binary Component 


Associated Binary Digits 











00 


1 





1 


01 


2 


1 


1 


11 


3 


1 





10 


4 


2 





00 


T) 


2 


1 


01 


t) 


3 


1 


11 


7 


3 





10 


8 


4 





00 


9 


4 


1 


01 



to an 8 or a G, but only the correction to 6 would correspond to a 
change in the second binary digit of the associated binary message. 

If the first of the associated binary digits is the odd or even indication 
of a quinary component of a decimal digit, a decimal digit can convey 
ten states rather than the four states of the associated binary digits. 
The combination of binary and quinary digits shown in Table X may 
be called a reflected quibinary code because of its analogy with the re- 
flected binary code.* 

If a method were available for transmitting without error (e.g., by 
using an error correcting code) a message composed of the associated 
binary digits in a base b code, small errors could be corrected in the 
base b digits. 

An examination of Table X for resolving a decimal digit into binary 
and quinary components, reveals that a change of ±1 on any decimal 



* The reflected biuary code has the property that each increment changes only 
one binary digit; for example, the eight successive words of a three binary digit 
reflected binary code are 000, 001, Oil, 010, 110, 111, 101, 100. 
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digit will change only one of these two components. Further, an error 
corresponding to a change in the quinary component can be uniquely 
corrected if the error in the decimal digit is assumed to be ±1. For 
example, if a received is discovered to have an incorrect quinary com- 
ponent, only a decrease in the quinary component making the decimal 
digit 5 is a possible correction, since an increase in the quinary com- 
ponent would correspond to the decimal digit 9, a change of more than 
±1 from 6. 
A system is shown in Fig. 2 for taking advantage of these properties. 



INFORMATION SOURC£ 



QUINARY 

INFORMATION 

DIGITS 



ODD OR EVEN 
RECOGNITION CIRCUIT 



BINARY 
DIGITS 



BINARY 

INFORMATION 

DIGITS 



SYSTEMATIC BINARY ERROR 
CORRECTION CODE ENCODER 



BINARY MESSAGE 

INFORMATION 

DIGITS {NOT USED) 



BINARY PARITY 
CHECK DIGITS 



INFORMATION RECEPTOR 



BINARY 

INFORMATION 

DIGITS 



QUINARY 

INFORMATION 

DIGITS 



QUINARY 

CORRECTION 

CIRCUIT 



BINARY 
DIGITS 




ODD OR EVEN 
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CIRCUIT 



BINARY DECODER 
AND CORRECTOR 



2 



BINARY 

DIGITS 



Fig. 2 — Use of binary codps with a decimal channel. 



1374 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1957 

In this example, an information somxe generates n quinary and n — m 
binary information digits for each message. All quinary digits go through 
an odd or even recognition circuit to be converted into binary digits for 
the purpose of generating a binary error correction code message. These 
binary digits and the binary digits generated by the information source 
arc fed into a systematic binary error correction code encoder whose 
output is a binary message containing 2n digits, of which m are parity 
check digits. This output is di^dded into two parts, 2n — m original 
inputs to the encoder unchanged by the encoding process (this is a sys- 
tematic encoder which does not change information digits in encoding), 
and m parity check digits. 

The m parity check digits are then combined with m of the ([uinary 
information digits through the use of the reflected quibinary combiner 
to form m of the decimal digits of the decimal message that is trans- 
mitted ; the other decimal digits are formed by combining the n - m 
binary information digits with the rest of the quinary information 
digits. 

The de(dmal message is transmitted over the noisy channel and arrives 
with one or more (a number limited by the choice of the binary code) 
errors of ztl on decimal digits. It is fed into a reflected quibinary resolver 
which resolves decimal digits into binary and quinary components in 
accordance with the reflected quibinary code (Table X). The quinary 
digits are then fed into an odd or even recognition circuit to form binary 
digits; these and the binary outputs of the resolver are fed into a binary 
decoder and corrector, working with the same code as the binary en- 
coder. The output of this corrector should correspond to the output of 
the original binary encoder. 

In the decoder, the binary digits are corrected. When the binary digit 
derived from a quinary digit is corrected, however, the quinary digit is 
not yet correct. The correction of the quinary digit is performed by 
examining both the corrected binary digit derived from the quinary 
digit and the corrected binary digit which was derived from the same 
decimal digit as the quinary digit in ciuestion. The rules for correc^ting 
the quinary digit are given in Table XI. 

As an example, consider the application of a Hamming Code for 
transmitting ten binary digits in a fourteen binary digit message. 

Using a code of this type, single errors of ±1 may be corrected in a 
seven digit decimal message, transmitting seven quinary digits of in- 
formation and three binary digits of information. The characteristics 
required for a fourteen binary digit Hamming Code message are shown 
in the first column of Table XII, 
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Table XI — Correcting Quinary Digits 



Q 






Correclion of 






Quinary Digit 


Even 








None 


Even 





1 


None 


Even 


1 





-1 


Even 


1 


1 


+ 1 


Odd 








+ 1 


Odd 





1 


-1 


Odd 


I 





None 


Odd 


1 


1 


None 



Table XII — Bin'ary Code used for Correcting 
Decimal Message 



Binary 

Characteristics 



1 
10 
11 
(I I 

10 1 
Olio 

(1111 

10 
10 1 
10 10 
10 11 
110 
110 1 

1 1 I 



Pjiriiv Check Digt 
Parity Check Digit 

Paiil\- Check Digit 



Purity Cheek Digit 



(0) 

(0) 

I 

(1) 



1 

(I) 

1 




1 
1 





(0) 
(0) 

1 

(!) 


3 

(1) 
3 
2 
4 
I 
3 




Position in Decimal Message 



Hinary comp. 
Biriiiry comp. 
Binary comp. 
Birmrv comp. 
Binary comp. 
Binary comp. 
(Quinary com]) 
Binar>- comp. 
Quinary comp 
Quinary comp 
Quinary comp 
Quinary comp 
Quinary comp 
Quinary comp 



of 1st digit 
of 2n<l digit 
of 3rd digit 
of 4th digit 
of 5th digit 
of 6lh digit 
. of 7lli digit 
of 7th digit 
. of 6th digit 
. of 5tli digit 
. of 4(h digit 
. of 3rd digit 
. of 2iid digit 
. of 1st digit 



To illustrate the method completely, a stric^tly buiary example will 
firwt be illustrated, then a related decimal example. In column a of Table 
XII, the digits of a binary message are mdicated and in column b, the 
binary and quinary information digits. The values of the parity check 
digits, which arc shown in parentheses, are calculated by the u.sual for- 
mula. Let Cij represent the jth digit of the characteristic of the ith 
digit {including parity check digits): 



X; XiCi = mod 2. 



(52) 



This formula applies for all values of j and in this case will yield four 
implicit equations each with one unknown term, the value of the parity 
check digit. U.sing the given values of the binary information digits, 
the values of the parity check digits are calculated. These are shown in 
parentheses in Table XII. 
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The binary message is 

00110011100110. 

For this example, the quinary components (quinary information digits) 
of decimal digits are chosen odd if the corresponding digit of the binary 
example is 1, even if that digit is 0. The binary and quinaiy components 
are then combined by the rules of the reflected quibinary code to form 
the decimal digits 7 2 9 4 7 6. For example, the quinary and binary 
components of the fifth digit are 2 and 0, respectively; the decimal digit 
which has these components is 4, the fifth decimal digit of the message. 
Consider the bmary case. Suppose that the message is mutilated in 
transmission so that the tenth digit is received incorrectly. The message 
is mutilated from 

00110011100110 

to 

001 10011110110. 

The decoder and corrector calculates the corrector by 

Cj = L x'iCii mod 2. (53) 

,-=1 

In this formula, cy is the jth digit of the corrector and Xi the received 
value of .T, . In this example the corrector is 1 1 0, which means that 
the tenth digit, which has this charat^teristic, is wrong and should be 
changed to 0. 

The corresponding error in the decimal example is a change in the 
fifth digit from 4 to 3. If the message 072937Gis received, the 
resolver and quinary to binary converter delivers the message 

00110011110110 
to the decoder instead of 

OOllOOlllOOllO 

corresponding to the correct message. The corrected binary message is 
produced at the output of the decoder and corrector. When the quinary 
and binary components of the fifth digit are examined by the quinary 
correction circuit, the following inputs exist; 

Received qumary digit 1 (Odd) (quinary component of 



Corrected binary digit 

derived from quinary (5i) 

Corrected binary digit 

from same decimal number (^2). 



received decimal 3) 
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Tabic XI shows that the quinary digit must be increased by 1 to 2, 
which combined with the binary conveyed by the same decimal digit 
yields a decimal value of 4, the original transmitted value. 

The best semi-systematic simple characteristic code for correcting 
single small errors in a seven digit message allows X 10'^ possible mes- 
sages in a seven digit message (see Table V), whereas this code allows 
6.25 X 10^ This code is therefore slightly more efficient. In addition, 
this code has the special advantage that any error of ±2 on one digit 
is recognizable since the corrector will have a value of 1111 for the asso- 
ciated binary message. (An inspection of the choice of characteristics 
and assignment of characteristics to the two components of any decimal 
digit will confirm this.) 

This general technique can be applied to any base h channel, provided 

Table XIII — Compo.vents of Quinahv Digits 



Mixed Digit 


Infonnation Digit 


Quinary Digit 


Info. Comp. 


Check Comp, 


Quinary Digit 


Binary Comp. 


Ternary Comp, 




1 

2 
3 
4 





1 
1 

not used 




1 
1 


not used 




1 

2 
3 
4 




1 
1 








1 
1 

2* 



* If r|uiii;iry information is initially generated, the combination {1, 2) will not 
occur. 



that h is greater than 3. For odd bases, the digits which convey a parity 
check component and an information component caiuiot be utilized effi- 
ciently since one state of the base b digit is not available. For example, 
using a base 5, (see Table XIII), only two information and two parity 
check states may he conveyed by one digit, since the use of a third infor- 
mation state would require at least six states for the mixed digit. In 
the case of information digits, however, all .states caii be used. In the 
quinary example, the resolution of a digit into two components and the 
subsetjuent recombination is subject to the restraint that one of the com- 
binations (1,2) will not occur, which can be assured if the information 
source generates quinary digits. 

For the case of high redundancy codes having the property that the 
a.ssociatcd binary code contains more than 50 per cent parity check 
digits (corresponding to a negative value of n — -m in Fig. 2), at least 
some of the base h digits nuist convey two or more parity cheek digits. 

This can be easily accompli.shcd; a decimal digit can convey three 
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Table XIV — Decimal Digit Conveying Three Binary Digits 



Decimal Digit 


Binary 


I^omponents 











1 





1 


2 





1 1 


3 


n 


1 


4 


1 


1 


5 


1 


1 1 


6 


1 


1 


7 


1 





8 


not used 


9 


not used 



parity check digits if a simple reflected binary code correspondence be- 
tween binary and deinmal digits is maintained as shown in Table XIV. 

An extension of thin idea is the encoding of the original iiiformation 
(i.e., the information that is shown coming out of the information source 
in Fig. 2) in some error detection or correc^tion code. For example, the 
decimal to reflected quibinary code resolver will cause both components 
to be incorrect if an error of d=2 ui a decimal digit occurs. In this case, 
the system sho^vn in Fig. 2 will automatically make a correction on the 
decimal digit of either +2 or -2 depending upon the value of the re- 
ceived decimal digit, and provided a double error correction liinary 
code is used. Such a correction will be incorrect about half the time. If 
the received binary digit is compared to the corrected binary digit and 
the received qumary digit is compared to its corrected odd or even digit, 
an error of ±2 can be detected without changmg the code. If one extra 
binary check digit, treated as an mformation digit by the encoder and 
decoder, is transmitted in the message, this binary digit can convey the 
information necessary for determining the sign for a correction of ±2, 
provided that only one such correction is required for any one message. 
A rule for determining the value of this digit is; 

Be = if 2 Qi = (0 or 1) mod 4, 

(54) 

Be = 1 if E 5' = (2 or 3) mod 4, 

where g, represents the ith. quinary information digit, and B. represents 
the special check digit. If the received message (!ontams one error of ±2 
on a digit, two possible corrections may be made on the quinary compo- 
nent of this digit; ±1. Obviously, only one of these corrections will 
.satisfy the equation for determining Be since the two possible corrected 
values of q are two units apart. 
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Note that the associated binary codes for performing such a correc- 
tion must have the property that two biliary digits may be corrected 
since an error of =b2 corresponds to incorrect values for two asso(;iated 
binary digits. If the noise is such that errors of ±2 are not very unlikely, 
it may be desirable to place the binary and the (juinary components of 
any one decimal digit in a different binary error corre(!tion code word so as 
to make the errors independent. In a seven decimal digit message, as an 
example, the quinary components of the first four decimal digits can be 
used to generate parity check digits which are conveyed by the binary 
components of the last three decimal digits. The binary component 
of the fourth decimal digit (this might be B^) and the quinary com- 
ponents of the last three decimal digits generate parity check digits 
conveyed by the bmary components of the first three decimal digits. 
Two separate binary error correction code messages are then conveyed 
by a single seven digit decimal code message. Each message is in a four 
information digit, three parity check digit Hamming Code. Through the 
use of this code, one error in the binary component of any decimal digit, 
and one error in the quinary component of any decimal digit may be 
corrected. 

In certain cases, the quinary digits themselves might be encoded in an 
error correction code for single unrestricted errors before the binary 
process is carried out. This is helpful chiefly for occasional large errors, 
leading to initial miscorrections. 

The variations based upon the principles described, which can be 
applied to any channel, provided 6^4, including the pyramidmg of one 
code scheme upon another, are almost endless. Generally, the last 
encoding and first decoding step should be able to correct many more 
errors than the first encoding step. For example, if ciuinary components 
are encoded in single unrestricted error correction quinary code, the bi- 
nary code should probably be a triple or quadruple error correction code; 
otherwise a correction may not correspond to the most probable error 
condition, and the correction scheme loses its effectiveness. 

These techniques cannot be conveniently applied to the ternary chan- 
nel, since a ternary digit cannot be resolved into two components effi- 
ciently. 

6.2 Multiple Small Error Correction Codes 

One limitation of the above techniques is the requirement for a sys- 
tematic binary code; i.e., a code in which some of the binary information 
digits are transmitted directly, and others are determined by parity 
checks on information and previously calculated check digits. These 
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Table XV — Reed-Muller Codes — 256 Digit Message 



Number of Digits o( Infornulion per Message 


Number ot Errors Correctable per Message 


255 





247 


1 


219 


3 


163 


7 


93 


15 


37 


31 


9 


63 


1 


127 



syHtematic codes are conveniently applicable only to the correction of 
single errors and a few special cases of multiple errors. 

The Reed-MuIler'" codes are not systennatic codes, ("systematic" 
being used in the narrow sense indicated above, not in the sense of Ham- 
ming"), but offer the advantage that multiple error correction is rela- 
tively straightforward. For this reason, it is desirable to find some way 
of adapting the binaiy Reed-Muller codes for correcting a number of 
small errors in non-binary codes. 

To explain the nature of the Reed-Muller codes completely is beyond 
the scope of this paper; a list of their important features is sufficient. 

This is; 

1. The length of a message is 2" binary digits for the simpler versions 

of the code. 

2. If Cf represents the number of combinations of d items taken 
c at a time, and C/ = d\/[c\{d - c) !], then 2' - X)"=o ^-; information 
digits may be transmitted correctly in a message containing 2 digits, 
if no more than 2'" — 1 errors occur in the messages; 2'" errors are de- 
tected but they are not always correctable. The Reed-Muller codes for 
correcting a large number of errors will frequently correct more than 
2'" - 1 errors, and will always correct 2"' - 1 or fewer errors. 

The.se values are given for a 256 digit me-ssage in Table XV. 

3. Each digit of the transmitted message is a parity check of a group 
of digits from the information source; the message cannot be broken down 
into information digits and check digits. 

4. The decoding is accomplished by a number of majority decisions 
among different groups of message digits. 

A techniciuc will be de.scribed for using a Reed-Muller code efficiently 
to correct a number of small (±1) errors for any code base h that is a 
multiple of 2, and also, at a small sacrifice of efficiency, a number of larger 

errors. 

A theorem, stating that any code which is generated by a set of parity 
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checks will contain the same set of allowable messages as some systematic 
code, was pro\'ed by Hamming." In particular, such a theorem indicates 
that a Reed-Mullcr code will contain the same set of allowable messages 
as some systematic code. This was also proved by Slepian, ' who has given 
a simple method of deriving a systematic code generating the same set 
of messages as a Reed-Muller code. For convenience, such a code will be 
called an SERM code (Systematic Equivalent Reed-Muller code). 

A Reed-Muller decoder serves to derive the information digits from a 
message in Reed-Muller code which may have been mutilated by noise. 
If a Reed-Muller decoder is followed by a Reed-Muller encoder, the com- 
bination serves as a noise eliminator (provided the iioisc is within the 
correction bounds of the code), since the output of the encoder is the 
noiseless Reed-Muller code message that is equivalent to the noisy 
message that entered the decoder. This property is useful since it means 
that any mesisage, drawn from the set of Reed-Muller code me.ssages, 
which has not been mutilated outside the bounds set up by a particular 
Reed-Muller code, will be restored to its origmal form, l)y a Reed-Muller 
decoder followed by a Reed-Muller encoder. Since an SERM code will 
produce only messages included in the set of messages of the correspond- 
ing Reed-Muller code, the SERM code can be used in conjunction with a 
Reed-Muller decoder and encoder to permit transmission over a noisy 
channel in a systematic code. 

The two systems shown in Fig. 3 are therefore equivalent in their 
error correction properties. In both cases, messages from the set of Reed- 
Muller code messages are .sent, and suice the same decoder is used ini- 
tially, both systems will correct errors in the received message in the 
same manner. The Keed-Muller encoder in the second system is re- 
([uired because a Reed-Muller decoder does not correct a message but 
derives information digits from the received message directly. The 
derived information digits, however, necessarily correspond to some 
corrected form of the received message and, m effect, the decoder performs 
the same correction as it would perform by deriving the corrected form of 
the message first. 
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Fig. 3 - — Equivalent systems using SERM and Reed-Muller codes. 
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Table XVI — Multiple Sm.'^ll Error Couhbction Code 
Using SERM Codes with Decimal Channel 



Message Length 


Information Digits 

(Equivalent Decimal 

Digits) 


Check Digits 

(Equivalent Decimal 

Digits) 


No. of Small Errors 
Correctable per mes. 


128 
128 
128 

128 


127.7 
125.3 
116.9 

100.0 


.3 
2.7 

n.i 

28.0 




1 

3 

7 



This means that a Reed-Muller code can be adapted to the system 
shown in Fig. 2. The Systematic Binary Error Correction Code Encoder 
is simply an SERM encoder; this is permissible since the SERM codes 
are systematic. The Binary Decoder and Corrector is simply a Reed- 
Muller decoder followed by a Reed-Muller encoder. Everything else 
remains unchanged. 

This scheme offers flexibihty for the correction of large numbers of 
small errors. Proper initial error correction encoding of the original in- 
formation digits will permit correction of a small number of large errors. 

Table X\T shows some typical cases of the correction of many small 
errors in a decimal message as a function of the number of information 
and check digits in a message of constant length. For convenience, every- 
thing is shown in equivalent decimal digits, even though in the actual 
code, binary and quinary information digits are used. Only the first few 
entries are considered, since the message composed exclusively of the 
digits 0, 3, (5, 9 in which any number of small errors in a decimal channel 
may be corrected (this code is described by the first entry of Table V) is 
more efficient than the codes corresponding to subsequent entries on 
Table XVI. This code, which is very easy to instrument, will transmit 
the equivalent of 77 decimal digits in a 128 decimal digit message. 

One problem not efficiently solved by these techniques is the multiple- 
error correction ternary channel problem. A technique which can be 
used is a code identical to the regular binary Reed-Muller Code, except 
that all equations will be modulo 3 instead of modulo 2. In decodmg, this 
will sometimes require subtraction instead of addition; in modulo 2 
equations there is no difference between these operations, but m modulo 3 
equations, the two operations are distinct. The same procedure can be 
used for correcting multiple unrestricted errors in any base. 

VII. iterative codes 

All the codes described above have one disadvantage; occasional ex- 
cessive noise will yield a non-correctable message. In order to approach 
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error free transmission, some iterative coding procedure may be used. 
This problem has been solved by Elias.'^ His methods are directly Jippli- 
eable to non-binary codes, since nothing restricts the digits to binary 
values. 

In order to minimize the complexity of an iterative coding procedure, 
systematic codes are desirable. The advantages of the Reed-Muller code 
are significant however, especially for the case of a relatively noisy 
channel. A sound procedure for a binaiy channel would therefore be to 
use SERM codes, (see Fig. 3) ; such codes are more efficient than iterated 
Hamming Codes in a relatively noisy channel. 

VIII. SUMMARY AND ANALYSIS 

Many codes have been presented in this paper, all constructed by 
some combination of procedures involving linear congruence or modulo 
eciuations. 

In most cases, more efficient codes exist. Exhaustive procedures exist 
for deriving maximum efficiency codes, although the codes derived in 
this manner usually require an extensive codebook, both at the encoder 
and at the decoder. Even for simple single error correction binary (^odes, 
the most efficient code is not always a systematic code. For example, 
the best systematic single error correction binary code working with an 
eight digit message has only 16 different allowable messages; it is known^* 
that a non-systematic code with at least 19 allowable messages exists. 

In the case of non-binary codes, the situation is somewhat worse. 
Very few of the codes given in this paper take advantage of the fact that, 
for most situations, a digit that is incorrectly received as or 6 — 1 is 
usually corrected only in one direction and no need exists to specify 
whether the correction is ±1. Most of the codes are arranged so that 
any received digit may be corrected either positively or negatively. No 
codes have been found which take full advantage of such a property, 
other than codebook codes, except for isolated instances of short message 
codes having symmetrical properties. For example, the single digit, 
single small error correction decimal code having 0, 3, 6, 9 as the allow- 
able messages takes full advantage of this property, and is, at the same 
time, a true semi -systematic code. 

It is extremely difficult to find the ultimate limits of efficiency of code- 
hook codes. The exhaustive procedures are totally impractical except for 
very short messages. If an analysis is restricted to codes which do not 
take advantage of the property that certain ^ alues of digits may be 
corrected in only one direction, and it is assumed that each possible 
message is mutilated to the same number of incorrect messages, one 
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limit to the efficieiK^y of codes may he found. This limit can be derived 
from the fact that an error correction code decoder and correction cir- 
cuit must be able to convert any message which contains errors within 
the bounds of the correction performed l>y the code, into the value of 
the mef^sage as originally transmitted, or must be able to derive the 
original information which was fed into the encoder. Thus, if each mes- 
sage may be mutilated in w ways, and still be corrected, then at least w 
messages must be associated with each allowed message. This is indi- 
cated diagram mat ically in Fig. 4. The messages produced by the encoder 
are shown at the left; each one fans out to w — 1 mutilated messages 
plus the original message. The decoder converts any of these w messages 
into the original message. 

The value of w can be determined by taking all possible combinations 
of errors that can be corrected by a coding system. For example, for a 
code system which can correct up to (d — l)/2 small errors in different 
digits in an n digit message, w is given by 

where d is the minimum distance between messages, and 



cr - 



n\ 



{n - i)[i[' 



This equation merely signifies that w is the sum of all combinations of 
positive and negative (accounting for the 2 term) errors in up to 
{d — l),/2 different digits out of n digits. For single errors, w = 'In + 1. 
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Fig. 4 — Graphical representation of an error correction code. 
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The number of different messages that can be produced by the en- 
coder must be no greater than h^/w, subject to the above restriction, &" 
representing the maximum number of messages that the decoder may- 
receive as an input. If only systematic and semi-systematic codes are 
considered, the number of messages is limited to multiples of powers of 
h and of the information component base /3 of mixed digits. The number 
of check states must be at least as large as w, so that w different correc- 
tors may be calculated and associated with w different corrections. 

Subject to the above restrictions, the following statements may be 
made. 

1. The systematic single small error correction codes derived using 
the rules of Section III are the most efficient systematic single small 
error correction codes possible. For those codes in which the two sides 
of inequality (8a) are equal, no code, not even a non-systematic code, is 
more efficient. 

2. The systematic single unrestricted error correction codes derived 
using the rules of Section 4.1 are the most efficient systematic single 
unrestricted error correction codes. For those codes in which the two 
sides of inequality (31) are equal, no code is more efficient. 

3. No codes are more efficient than those semi-systematic codes, 
derived using the rules of Section III, for which the two sides of in- 
equalities (28) and (29) are equal and mi = 0. It is difficult to make 
more general statements about semi-systematic codes, because spe- 
cial techniques (such as those of Section VI) , not all of which are known, 
may be used with these codes. 

For multiple error correction codes, other techniques are both simpler 
and more efficient than the straight systematic and semi-systematic 
techni(iues described in Sections III, IV and V. One such scheme has 
been described in detail in Section VI. No codes have been found which 
approach the limit set by w, but the codes described in Section 6.2 are 
moderately efficient. 

Throughout this paper, all techniques which involve vast complica- 
tions at the expense of slight additional efficiency have been avoided. 
Codebook methods are always possible. If a technique is almost as com- 
plicated as a codebook technique with only slightly greater efficiency 
than a simple technique, the simple technique would always be used in 
practice, and the codebook satisfies the mathematical and theoretical 
requirements. In a sense, a really complicated technique is only useful 
for deriving a better lower Umit for the maximum effi(dcncy of a code- 
book code. In the non-binary case, however, a codebook system is con- 
siderably more efficient than any code system which does not take ad- 
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vantage of the fact that all transmitted messages are not mutilatable to 
an equal number of correctable received messages. 

From the point of view of deriving lower limits to the maximum effi- 
ciency of a Godebook technique, such a consideration is vital. Except for 
a few relatively trivial cases, no codes have been found which take sig- 
nificant advantage of the above consideration, for deriving such a 
limit.* 

IX. CONCLUSION 

In this paper, techniques have been presented for deriving error cor- 
rection codes for non-binary systems. None of the methods presented 
are overly complicated, nor do they require excessive storage capacity 
for either the encoding or decoding and correction system. 

The codes are sufficiently simple so that their use with a non-binary 
storage system may be considered, and the development of such a 
storage system shoukl not be stopped because a system without flaws or 
not subject to noise cannot be realized. 

An important disadvantage of using error correction codes with such 
a system is the time rec[uirement. Correction usually requires a signifi- 
cant amount of time. This is probably one reason why the Hamming 
Code is not used more extensively. The more advanced and complicated 
(Kjdes, such as the Reed-MuUer Codes, suffer particularly from the 
amount of time required for a correction. The codes described in this 
paper are therefore probably best suited to medium or low speed stor- 
ages, which are not read too frequently. 

A study of this type may be of some interest to those who have been 
considering the use of multi-state devices for building switching systems 
and computers, since this paper represents a study of a typical problem. 
Certain lessons may be derived from this study: 

1. liestriction to a single number base for all operations is a severe 
handicap. The more advanced codes pre.sented in this paper, require 
extensive use of different number base operations. The ability, inside 
the computer, to change number bases for different operations, may well 
be useful. 

2. Different problems are best solved using different number bases. 
For example, the use of an even number base is desirable for multiple 
small error correction codes, while the use of a prime number base is 
desirable for (correcting single large errors. It is the author's opinion that 

* Note that thi.s restriction has less significance in the case of binary codes. In 
a symmetrical channel with only two available signals, each value of a digit may 
be changed in as many ways, namelj', one, as every other. 
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number bases which are the product of several small factors are best. 
Suggested values are six, teu and twelve. Number bases with two differ- 
ent prime factors, may offer an advantage, since they permit simple 
translation and change of number base among at least three different 
numbers. 

In the comparison between binary and non-binary error correction 
codes, the following observations may be made: 

1. Keeping the amount of information per message fixed, a binary 
single error correction code is less efficient than a non-binary single 
small error correction code, provided h, the channel base, is greater than 
three, but is more efficient than a non-binary single unrestricted error 
correction code. 

2. Non-binary codes arc sUghtly more complicated to implement than 
binary codes; this applies to multiple error correction codes as well as to 
single error correction codes. The amount of added complication is in no 
case really extensive. 

It was initially hoped that this study might also produce some addi- 
tional binary error correction techniques. One such technique was dis- 
covered: the use of a systematic equivalent Reed-Muller code to ap- 
proach error free coding (see Section VII). 

Finally, the author wishes to express the hope that further work on 
non-binary systems will be encouraged by this study. 

ACKNOWLEDGEMENTS 

This work was performed under the part-time Graduate Study Plan 
of Bell Telephone Laboratories at the Columbia University School of 
Engineering under the guidance of Prof. L. A. Zadeh. The author wishes 
to acknowledge the help of Prof. Zadeh, both in the selection of a dis- 
sertation topic and in the subsequent guidance of the study. In addition, 
a number of helpful discussions with C. Y. Lee and A. C. Hose helped 
to guide the research into a study of the most significant problems in 
the field. 

REFERENCES 

1 R W. Hamming, Error Detecting and Error Correcting Codes, B. S.T.J. , 29, 

p. 147-160, April, 1950. 
2. Of Current Interest, Elec. Engg., p. 871, Sept., 1956. 
;i C Y Lee and W.H. Chen, Several-Valued Combinational Switching Circnits, 

TraiLs. A.I.E.E., 75, Part I, p. 278-283, July, 1956. 
4. D. Slepian, A Clii.ss of Binary Signaling Alphabets, JJ.S.T.J., 35, p. 203-234, 

Jan.. 1956. 



1388 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1957 

5. Hamming, op. cit., Section 1. 

6. M. J. E. Golay, Notes on Digital Coding, Proc, I.R.E., 37, p. 657, June, 1949. 

7. W. Keister, A.. E. Ritchie, and S. H. Washburn, The Design of Switching Cir- 

cuits, ]). Van Noatrand Co., Inc., New York, I95I, p. 316. 

8. M. J, E, Golav, Binary Coding, 1954 Symposium on Information Theory, 

Tran.s. I.R.E., PGIT.'4, p. 23-28, Sept.;i954. 

9. G. H, Hard}' and E. M. Wright, An Introduction to the Theonj of Nu7iibers, 

Oxford University Press, Oxford, ]954, p. 51, Theorem 57. 

10. I. S. Reed, A Class of Miiltiple-Error-Correcting Codes and the Decoding 

Scheme, 1954 Symposium on Information Theory, Trans. I.R.E., PGIT-4, 
p. 38^9, Sept., 1954. 

11. Hamming, op. cit., Section 7. 

12. D. Slepian, A Note on Two Binary Signaling Alphabets, Trans. I.R.E., IT-2, 

p. 84-86, Jime, 1956. 

13. P. Elias, Error Free Coding, 1954 Symposium on Information Theory, Trans. 

I.R.E., PGIT-4. p. 29-38, Sept., 1954. 

14. V. I. Siforov, On Noise Stability of a Sy,stem with Error-Correcting Codes, 

Trans. I.R.E., IT-2, p. 109-115, Dec, 1956. See Table II, Column 8. 



